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Abstract 

A neural network mechanism that can compensate for poor optical 
quality was recently discovered in a biological context. We propose 
that this mechanism can and should be adopted for astronomical pur- 
poses. This would shift emphasis away from the quality of the optical 
equipment to information processing, hence should decrease the cost 
and make larger instruments feasible. 

In astronomy, it is desired that a telescope be as large as possible, so that 
light-gathering power is increased and fainter sources can be seen. However, 
producing large mirrors to the accuracy desired for sharp image formation at 
the focus is very technically challenging and prohibitively expensive. Also, 
large mirrors are very massive, and their weight puts considerable mechanical 
stress on the support structure and can deform the mirror itself. Therefore 
there exist no single-mirror telescopes with aperture larger than 8 m. 

Here we propose another method for astronomical observation: We do 
not require the telescope to focus the light exactly, but only to collect it onto 
the pixellated light detector ("PLD", e.g. a CCD). Then a neural network 
would recreate the image by taking superpositions of all PLD pixel signals 
for all image pixels. 

Nature already does this, as reported in a recent Letter P , whose results 
we summarize briefly: 

*mail: ibrahim.semiz@boun.edu.tr 



1 



Some snakes possess an infrared sense organ ("IR pit") which is an op- 
tically very poor camera, yet they are able to achieve good spatial resolu- 
tion. This is accomplished by a network of synaptic connections between the 
infrared-sensing cells in the IR pit and the optic tectum in the brain. This 
neural network has to be trained by comparing the optic image from the eye 
with the " image" from the IR pit |2] . 

Consider an object to made up of equal number of points as the infrared- 
sensing cells (and in the same geometrical configuration). Each sensing cell 
may receive light from each object point. If the object points and the sens- 
ing cells are labeled by i and j respectively, and the intensity emitted and 
detected by the image points and sensing cells are denoted by and i/j 
respectively, the effect of the IR pit can be described by a transformation 
matrix: 

y = Tix (1) 

where the matrix Ti is determined by the geometry of the IR pit. 

Now, consider the intensities received by the sensing cells to be recom- 
bined again to give the intensities of another set of points z^, which we can 
call "image" pixels: 

z = T2y (2) 

Here, the elements of the matrix T2 are the strength of the synaptic con- 
nections between the j'**^ sensing cell and k^^ region in the optic tectum. Of 
course, successful IR vision means that the image is the same as the object, 
i.e. z = X, therefore it must be arranged for the matrix T2 to be the inverse 
of the matrix Ti. The training of the IR vision of the snake consists of the 
adjustments of the connection strengths by inhibitory and excitatory neural 
interactions so that this is the case. 

The neural network telescope (" NNT" ) we propose in this Letter embod- 
ies the same principle. A large light-collecting device, possibly a mirror, 
takes the place of the IR pit, a human-made PLD the place of the sensing 
cells, a hardwired neural network or a computer the place of the synaptic 
connections, and a display the place of the optic tectum. 

To "train" the NNT, we must determine the matrix elements of T2. To 
this end, we can point the telescope to a (real or artificial) point source 
in its field of view so that only one Xi is nonzero, measure all shift the 
telescope (or the artificial point source) slightly so that the next Xj is nonzero 
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and repeat, thereby determine the matrix elements of Ti column by column. 
Inverting it will give the desired T2, which then can be built in as strength 
of the corresponding connections or used by the reconstruction software. 

Of course, in a perfect regular telescope, the focusing of light by the 
mirror makes a one-to-one assignment between the object points and the 
PLD pixels, i.e. Ti is proportional to the identity matrix. 

The snakes investigated in pQ have about 40x40 sensing cells, while a PLD 
may be of the order of megapixels (the original HST camera was 800x800 
pixels |3j). Since the inversion of an x matrix takes 0(A^^'^''^) operations 

we need about 10^ s on a 10 GigaFLOPS computer for a one- megapixel 
sensor. The standard desktop computers are approaching this performance, 
and 10^ s is acceptable, since the inversion needs to be done only once. Im- 
age reconstruction corresponds to the multiplication (j21), which takes 0{N'^) 
operations and therefore can be done in a few hundred seconds. Of course, 
dedicated computers will be faster, in fact, some consumer game consoles 
and graphic cards claim speeds of TeraFLOPS; naturally, future computers 
will be even faster. 

The angular resolution of a NNT will be 

R^^ (3) 

n 

where AO is the angular size of the field of view, and n is the number of 
pixels on one edge of the PLD [N ~ n^). In the snakes' case, the expected 
resolution is 100°/40 = 2.5° PP; of course in astronomy, much better reso- 
lution is needed. The obvious way of increasing resolution for a given PLD 
is making the field of view smaller; in fact, it can be said that a regular 
telescope does just this: The mirror makes the field of view of a given pixel 
almost zero. 

Therefore the optical, that is, light-gathering component of the NNT is 
required to collect -but not necessarily focus- light from a narrow field of view 
onto the PLD, and prevent light from outside the desired field of view from 
reaching it. Since the focusing properties do not have to be very precise, the 
light-gathering component can presumably be made cheaper and/or bigger 
then for regular telescopes. For example, 

(a) Monolithic mirrors comparable in size to the largest existing ones can 
be made at a fraction of their cost and in shorter time. 

(b) Arbitrarily large segmented mirrors can be constructed with fiat seg- 
ments, significantly reducing cost and production time; and by not attaching 
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segments rigidly to each other, and controlhng their position and orientation 
independently, thermal and gravitational deformations can be counteracted. 

(c) In a design with no mirrors whatsoever, a stack of parallel pipes with 
light-absorbing insides (Figure can be used to limit the field of view, which 
would then be the ratio of the width to length of a pipe. 

The area onto which light is collected may be large compared to regular 
telescopes, because of imprecise focus in (a) and (b), and no focus in (c). In 
this case, an array of photomultiplier tubes or avalanche photodiodes may 
also serve as the PLD, although this may drive the cost up with current 
prices. 

All of the above options are suitable for space telescopes, as well. The 
parts of both the very large telescope in (b) and the pipestack in (c) can be 
mass-produced on Earth or in space, since high precision is not needed; and 
the telescope assembled and calibrated (trained) on location. Of course, going 
to space also has the advantage of eliminating gravitational deformations. 

Unlike focusing accuracy, the rigidity of the optical element is essential. 
Gravitational or thermal deformations will change the matrix Ti, making 
the (real or virtual) neural network unusable. In option (b) above, this 
problem can, and should be, corrected. In some cases, if the temperature of 
the optical element is known to be uniform across its structure, but changes 
slowly in time, it might be possible to make the matrices Ti and T2 functions 
of temperature. 

Color images can be produced by superposing images taken with three 
color filters, but spectroscopy with the NNT seems difficult or impossible, 
since it does not produce a narrow coUimated beam which can be diffracted 
by a grating. This may change if future technology can produce pixels capable 
of measuring photon energies to high accuracy. 

Another advantage of the NNT is that it can work in any part of the 
spectrum, including X- or 7-rays, which cannot be focused in the usual, 
optical sense of the word. It is also interesting to note that the NNT idea 
would make no sense when the human eye or photographic film was the 
light-detector; it only would work in the CCD era. 

We would like to thank T. Rador and E. Giilmez for helpful discussions. 
This work was partially supported by grant 06B303 of Bogazigi University 
Research fund. 
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Figure 1: The "pipectack" option for the NNT. PLD is the grid at the closer 
end. 
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